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ABSTRACT 


An algorithm for the solution of integer linear programming problems 
is presented and programmed in Fortran IV for use om digital computers. 
The program incorporates an optional feature which provides all existing 
alternative optimal solutions. Solutions, computation times, and itera- 
tion requirements for each of thirteen test problems are summarized and 


discussed. 


LIDrary te ree LIBRARY 
U.S. Naval Postgraduate School GRADUATE SCHOOL 
Monterey, California 93940 MONTEREY, CA 93943-5104 


TABLE OF CONTENTS 


I INTRODUCTION ---------------------------------------------- 9 
II. THE ALGORITHM --------------------------------------------- a) 
III. PROGRAMMING CONSIDERATIONS -------------------------------- 19 
IV. TEST PROBLEMS --------------------------------------------- 25 
V. COMPUTATIONAL RESULTS ------------------------------------- 30 
VI. CONCLUSIONS ----------------------------------------------- 38 
APPENDIX A Input Data and Output Formats ----------------------- 40 
APPENDIX B Overlay Structure ----------------------------------- 42 
COMPUTER PROGRAM ------------------------------------------------ 44 
BIBLIOGRAPHY ---------------------------------------------------- de 
INITIAL DISTRIBUTION LIST --------------------------------------- 1S 
FORM DD 1473 ---------------------------------------------------- Lo 





Hees 


ele 


Ie 


LIST OF TABLES 


AD DITO aRES PROBE EMERES UIE NG eee teehee eet eee x 
SOMIGIONG 20 aes eeeet oa at eee oa eee eee ee a 
SECTIONS REQUIRED AND COMPUTATION. TIMES ----------------- 7 
A COMPARISON OF ITERATION REQUIREMENTS ------------------ 26 





FIGURE | 


LIST OF FIGURES 


THE OVERLAY TREE 





I. INTRODUCTION 


An algorithm presented by Dr. Harold Greenberg of the Naval Post- 
graduate School [1] provides an iterative procedure for the solution of 
the integer linear programming program: find 


ae (X15 Xo sees x) which 


minimizes 

C X (1) 
Subject to 

AX = B 
where 


O<x.<b., X. integer, j=l, ..., Nn. 
jp? 7 ee 


C is an n-vector, B is an m-vector, A is mx n, and the components of C, 
B, and A, as well as the b, are integer. 
A bounded variable linear programming algorithm [2] is first utilized 


to transform (1) into its equivalent problem (i.e., a continuous solution 


tO ae) 
minimize 
os a MO Coe 
jeH J 
Subject to 
Xe + _ ag X_ = a (2) 
where 


UX =) Xe INLeCeY a) =o Sikes: ie 
Sj i ee 


‘The first five subroutines of the program accomplish this portion 
of the solution and were provided by Dr. Greenberg. 
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Gis the set of indices of basic variables; H is the set of indices of 
non-basic variables; Xes Os» and a, are vectors, with Xe the vector of 
non-basic variables. 

If 0.4 is not all integer, the equivalent Knapsack Problem [3] is 


then formed: 


minimize 
2 Ca. 
jcH Jog 
Subject to (3) 
5B. xX. = Bg (mod 1) 
gen Jog . 


where kx.<b., X. integer. 
ees J 
The 8's are the fractional parts of the a's from (2) above, and as such 
are also vectors. 

The Knapsack problem is subsequently solved [1] using a dynamic 
programming enumeration which guarantees that all existing integer solu- 
tions can be found. Should there exist no feasible integer solution, the 
iterative process ceases after al] possible column vectors of fractional 


parts have failed to produce a feasible solution. 
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Il. THE ALGORITHM? 


1. Let the indices, H, be 1, 2, ..., m. Form the following tableau 


(subsequently referred to as a section): 


ee ee > m 
C, C, C 


By) 89 Bn 


and go to 2. 


2. (a) Given the (new) section, test for Br earice TOP sd) | aici te. 


for one or more j, B = Bo» select the minimum C. and call this C 
If C. ie oe , where Ea. was the os which produced the last feasible solu- 
tion, set - = C. and go to 4. 

(b) If, for all unmarked j in the current section, 8 7 By find 


* 
C. = min C. for all unmarked columns in all sections. If C. = oe , the 


* 
current solution corresponding to C, is the optimal solution to Clee 
* 
fi C. < C. , mark the column and go to 3. 
3. (a) Form a new section in the following manner: compute 


Ca = C. + C. , where the S are the values from the first section. If 


* 
C. ta do not add a corresponding column to the new section. Otherwise, 


continue by computing Bs = (ee + 8) mod 1 for all jeH (the B. are the 


values taken from section 1). For the X 5 = bss j # r, and x, + eo 


for j = r, for the section containing the newly marked column, do not add 


r 


“The majority of procedures presented here are taken from the original 
algorithm [1]. 
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the corresponding column to the new section. For columns which duplicate 
those already formed and for which the subsequent use of either column 
would result in identical values for the Xa do not add a column. 

(b) Underneath the new section, write the x values from the 
section containing the newly marked column. Increase Xv by one for the 
new section and go to 2. 

4. Take as a trial solution the values of the variables found below 
the section where es). with Xv increased by one. If the constraints 
in (2) are satisfied, replace the current feasible solution corresponding 
to the old a with the new solution and go to 2 (b). If they are not, 
replace the oo with the previous value and go to 2 (b). 

Example:° 
minimize 
) a ps lllip eo 3X4 +5 
subject to 
X) 7 3X, + 5X3 + Xy - 4X, > 2 
-2X) + 0X50 3X4 - Le wah wex 


on 
Iv 


- Xo + 2X. ~ Xq 


1 
x< 

on 

| Vv 
omumdl 


Dexa Xx Le Geiger = cen Oe 
=e j g J 


The surplus variables are added (x,-0, j=6,7,8) and the problem is solved 
for its continuous solution which yields the equivalent problem: 
minimize 


9 + 93/9 x, + 156/9 Xn t 42/9 Xp + 24/9 Xz + sGilyg) Xe 


This problem originally appeared as an example problem in [1] and 
was also used as test problem #10 for the program presented here. 


EZ 


subject to 


-7/9 Xy -28/9 Xq Plo /.9 Xp + X¢ +4179 xo = 21/9 Xe = 3/9 
-2/9 Xy + X2 8/9 Xq 7 4/9 Xp - 1/9 Xz - 6/9 Xe = 6/9 
-4/9 xy + Xo - 7/9 Xa toe /9 Xp - 2/9 Xa - 3/9 Xo = 3/9 


lhe ae KO elem eo Ste aI : 
O<x <I J X «<0 gs x; integer 
Section (1) is formed as follows: 


] 4 5 / 8 
93 156 42 24 81 


with aS (3276.5) 


Since min C. =e C. = 24 and r = 7. Mark column 7 in section (1) 


and form the new section: 


117 180 66 48 105 


(2) 
6 0 4 i a 
3 0 8 5 4 
* * * * * 
xX =] 
n 


Note that in column 1 of section (2) aera This means that an integer 
solution is obtained by substituting the non-basic variable values found 
below section 2 (with Xv ee Xy» increased by one) into the equivalent 


problem objective function and constraints. 


Is 


This yields the following solution: 


* 
Z °="2C, Xp = lle Xo = 1 Xo = I" X) = Te Xo = im 


* 
which satisfies the feasibility requirements. Set C = C; lae. ci = iy 
* 
(C can initially be considered ~). At this point, mark all columns for 


* * 
which C. > C (but not the C column itself) and select the next min C. 


= 42. Mark column 5 of section (1) and form the new section: 


] d\ 8 
135 198 147 
6 3 ] 
3 6 8 
3 7 
* 
Xp=l 


Note that columns 5 and 7 have not been formed. The former because Xp is 
now at its upper bound and can no longer be increased, the latter because 
it would duplicate column 5 of section (2) (the use of either will result 
in identical non-basic variable values). Also since c = 117, this entire 
section can be eliminated; use of any of its columns will result ina 
higher objective function value. 

Seclect the next min C. = 48, mark column 7 of section (2) and form 


the new section: 


5 if 
SOimme? Z 
6 3 (3) 
3 6 
6 3 
x 
X5=2 


a 
Since = >C ,j=t1, 4, 8, the corresponding columns have been omitted. 


Since column 7 has Bz = B> for the integer solution: 


* 
T= Vd. Xe = Ont bee f=. 01% Xo = eee tae, 


3 ] 


* 
which satisfies the feasibility requirements. C = 72 now replaces 
* * 
C = 117 and all previously formed columns for which C. > C are marked. 
Select the next min . = 66, mark column 5 of section (2), and form 


the new section: 


] 4 8 
159 222 147 
7 4 2 
2 5 7 
4 ] 2 
x . x 
X51 Xp=l 


But C. Bra for all columns of this section, so delete the entire section 
(column 5 had been omitted since Xp 1S at 1ts upper bound; column 7 had 
been omitted since it was a duplicate meeting the requirements for the 
omission of duplicates mentioned above). Select min C. = 72 and note that 
C. = oe which means the solution corresponding to o = 72 1S optimal. 

The algorithm as originally presented in [1] makes no provision for 
the recognition of an integer L.P. problem which, although it has an 
optimal feasible continuous solution, has no feasible integer solution. 
This means that such a problem, when operated on by a computer program 
utilizing the algorithm, will run indefinitely, or until space and/or 


time limitations are reached. This of course can be costly in terms of 


Me 


computer time, so a method is presented here, and incorporated in the 


program, for recognizing such infeasibility conditions.” 
Let 
A = the common denominator of the coefficients 
of the equivalent problem, 
g = (a, b) be the greatest common denominator of 
a and b, 
a! = (as, as. , 2 On ey = (1 eee Ae bemetie 
J ge mJ 
gth vector of fractional parts of the first 
section, 
94; = (a; 524); 
G. = Samii fea 
J cfc See ees 
. = . fOr cal) “jeana 
P; A/G or J 
— mCi ole 
c; cost 0 a 


Since the period, Ps: is actually the number of times column j can 
be added to any other column before the column j assumes its original 


values (mod a), it follows that 


> > > 
da+ D.d-) = soemniod A SoG 
J Pj ) Fr 


pia. = 0 (mod a). 


Therefore, the maximum number of distinct column vectors, M , which 


can be formed by the algorithm will be 
n 


me TP 
qeT P53 


this is because each column will assume p; different intermediate values 
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when operated on by any other column, either consecutively or in combi- 


nation with other columns, prior to reassuming its original values. 


> 


Note now that any vector, K, generated by the algorithm can be 


written in the form 


> > 
K = a. t 


ad 
ae et (mod A) 


los 


where O< y,< p, for all 2. Yo is necessarily integer and determined 
by the number of times column 2 was utilized in the formation of k. 
Note also that the individual ee terms are actually the intermediate 


> 
columns which were formed prior to K and which played a role in the for- 


-> 
mation of K. 

Since there is a definite upper bound on the number of distinct 
column vectors, a bound may now be placed on the costs which will be 


generated. The cost associated with any vector generated by the algor- 


ithm will be 


The last distinct column vector to be formed prior to repetition 


will be 


and the cost associated with this is 


a 


(p.-1) os 


jel 


By previous development, if we add any vector to the current one, say Jj=o, 


n = = n | 
ye (p:-1) a; + a. = & (p--1) a; (mod a) , 
ee a a 
J#o 
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since 
pa = O (mod 4). 
Oo OO 


Hence an upper bound (possibly not the least upper bound) on any cost, 


prior to all vectors being duplicated, will be 


61 2 5 


tus 


=) ae eo Way - 
(P. ) t. where t. ; (C50) 


j=! 


If, at any point in the search for feasible solutions, C' is reached 
and no feasible solution is found prior to the generation of the next 
section, it can be assumed (and is by the program) that no feasible 
integer solution exists. This follows since it has been shown that all 
columns formed subsequently will duplicate prior columns which have al- 
ready failed to produce a feasible solution. 

Note that, given a large enough common denominator, the value of C' 
can become extremely high. However, the time and space requirements 
become prohibitively high at the same time, and efficient utilization of 
the program appears very unlikely for such problems. (This is discussed 


in detail in the section on Computational Results. ) 


“The definition of ts allows a loose upper bound to be placed on 
costs for problems for which the continuous solution has one or more 
non-basic variables at their upper bounds (j.e., C. <7 
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III. PROGRAMMING CONSIDERATIONS 


Because all integer solutions to the congruence in (3) are systemati- 
cally produced in order of increasing objective function value while 
searching for a solution, the original algorithm [1] necessarily would 
require considerable core storage in order to accommodate each inter- 
mediate section. Accordingly, several changes are introduced, the first 
of which modifies the procedure for identifying feasible solutions. 

Rather than limiting a check for feasible solutions to the min C, 
column at each iteration, the new section is checked at the time of its 
formation for possible integer solutions. This allows the peremptory 
discarding of all columns, formed subsequent to the computation of a 
possible solution, for which the - are greater than the one which pro- 
duced the current feasible solution (i.e., if the column were retained 
and subsequently used to produce a feasible solution, the solution could 
not be optimal since the resulting objective function value would neces- 
sarily be greater than the current one; d + C.). The utility of this 
particular modification depends entirely on how early in the iterative 
process a possible solution ("base" C.) is found. 

The algorithm provides for the elimination of duplicate columns only 
if the use of either would result in identical non-basic variable values. 
The program, however, allows the elimination of all duplicate columns in 
an initial search for an upper/lower bound (depending on minimization/ 
maximization) on the optimal solution to the problem. The program then 
reruns the problem using the procedure originally specified by the algo- 
rithm in a search for the optimal solution. The bound p!aced on the 


optimal solution by the initial run of the program may be the optimal} 


1g 


solution itself; however, as will be explained, there is no guarantee 
that this will, in fact, be the case. 

By definition, a duplicate column contains duplicate fractional 
parts as well as C values. Hence, it can be shown that the objective 
function values will always be identical when duplicate columns are 
used to produce integer solutions; but the basic variable values will 
be guaranteed to be identical only when their corresponding non-basic 
variable values are equal. Therefore, when a duplicate column is allowed 
to remain, based upon the fact that when selected it will produce non- 
basic variable values different from those of the original column, it 
will subsequently produce a section identical to the one produced by its 
"sister" column but with a different combination of non-basic variable 
values. When a column from one of the identical sections satisfies the 
8, aah requirement for an integer solution, the different non-basic 
variable values can produce a feasible solution in one case and a non- 
feasible solution in the other. Hence, if one column were to be peremp- 
torily discarded, a feasible solution may be overlooked, and although 
the subsequent formation of duplicate columns may cause this solution to 
"reappear", it will continue to be lost due to its duplication. Test 
problem #3 demonstrates how this "course" duplicate column elimination 
method will run out of time and/or space prior to reaching an optimal 
solution. This is to be expected in a number of problems since an entire 
section necessarily takes longer to become totally marked, and hence its 
Space does not become available for reuse until much later in the itera- 
tions, if at all. (This will be discussed in more detail later in this 
section). The "course" method, therefore, provides at the very least a 


bound on the optimal solution, although in all of the test problems 
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included here, these bounds were, in fact, optimal solutions. The fol low- 
ing example should make clear, however, why this will not always be the 


Case. 


Assume that the following equivalent problem has been computed: 


eae ZNZ 5 10 
minimize ae i g Xo Z —e X3 
Subject to X + = Xo - = X, ~ _ 
5 6 ae aslee 
ea Oo ee ae) 





oes anv) 
ces 
5 610 
3 «6 (1) 
5 
k 

X;=0 
2 3 

are 
6 1 i) 
ef 
: 
Xo=1 


Now form two new sections (a) and (b) first using Column 3, section (1) 
then Column 3, section (2). 


2 | 


lé~»- 20 
1 4 (a) 
7 4 
Ko=l 
aC 3 
lbaueZ20 
It! (b) 
id 4 
Kn=2 


Note that ‘area solutions may be found in columns 3 of (a) and 3 of 
(b). For the solution from (a), substitute X. = 2 into the equivalent 
constraint equations and get X = | and Xa = 3, an infeasible solution. 
For the solution from (b), substitute Xo = 2 and X. = ] into the equiva- 
lent constraint equations and get Xy = 0 and Xa = 1, a feasible solution. 

Here, we see that if column 3 of (b) had been marked as being a dupli- 
cate, while column 3 of (a) had been retained, the solution would have 
been judged infeasible and all other solutions eliminated. This is, in 
fact, what happened in test problem number 9. It was not until the more 
strict "fine" duplicate column elimination criterial of the original algo- 
rithm were imposed that the "feasible" column was retained (this based 
upon the fact that, when chosen, it would produce different non-basic 
variables from its "sister" column) . 

For the same reason that a feasible solution could have been bypassed 
in the example, one could also have been overlooked which would yield a 


lower objective function value than the current solution. For example, 
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consider the case where, prior to the formation of sections (a) and (b) 
above, a possible solution had been recorded which utilized the following 


column from a previously formed section: 


(C.8.) = (28 4 4). 


It can be seen that the value of oF here would yield a higher objective 
function value than either of the two columns previously discussed. The 
optimal solution would then be bypassed by virtue of the course duplicate 
column elimination criteria. However, should the program run out of time 
and/or space on the "fine" run prior to reaching the sections containing 
the columns above, we would at least have an upper bound on the minimum 
objective function value. 

The two methods for duplicate column elimination are also made use of 
when the program is required to search for alternative optimal solutions. 
For the same reason that no optimal solution may be found on the first 
run, alternative solutions may also be bypassed. Hence, when the option 
to search for additional solutions is exercised, the program once again 
Searches under both modes of duplicate column elimination. Time and space 
limitations may be binding here also, but given enough of both, the program 
will provide all alternative optimal solutions when required. In problems 
where two or more optimal solutions are found in the same section, all are 
recorded (whether or not alternative optima have been requested by the 
user) since no additional iterations will be required. 

The principle space saving technique utilized by the program is one 
which makes section space available for newly forined sections once the 
columns of a previously formed section have all been marked. This is 


possible since the x, values associated with the original section will 
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never be utilized; at no time will a column be reselected once it has 

been marked, either as a potential solution or as the min , column. 
Several purely computer-related techniques were investigated in 

further attempts to decrease the core storage requirements of the program. 

Among these were the use of an overlay structure and the use of direct- 


6 
has been incorpor- 


access storage areas. Although an overlay structure 
ated in the final program, its use accounts for only a small saving of 
space. The use of the direct access devices did decrease storage require- 
ments considerably, but computation time increased on the average by a 
factor of six; this due primarily to the fact that the problems requiring 
the most space also require a considerable number of iterations, and pro- 


hibitively high direct access retrieval times for each iteration make the 


use of this technique highly inefficient. 


© Appendix B gives a brief discussion of the overlay technique utilized 
by the program. 
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ive, dleste PROBLEMS 


Problems 1 through 9 were taken directly from a collection of twenty- 
five integer programming test problems compiled at Stanford University by 
John Haldi [4]. Of particular interest were problems 1, 3, 4, 5, 6, and 
9. Upper bounds were computed for problems 1] and 3 using the "course" 
duplicate column elimination criteria, but the program ran out of space 
prior to reaching the optimal solution itself under the "fine" duplicate 
column elimination run. Problem 4 was a good test of how the program 
handles problems whose continuous solution includes non-basic variables 
at their upper bounds (i.e., the program allows negative S. values as 
long as the upper bound constraints are maintained for the integer por- 
tion of the solution). Problem 9 provided an example of how the "course" 
duplicate column elimination run can bypass the optimal solution by 
eliminating (marking) all columns duplicating the one which produced an 
infeasible solution, regardless of their corresponding non-basic variable 
values. 

Problems 5 and 6 are identical to problems 2 and 4 with the exception 
of one value in each. The Haldi paper gave optimal solutions for these 
two problems which did not satisfy the constraints as stated. However, 
with the modifications of problems 5 and 6, the answers given were both 
optimal and feasible. 

Problem 10 is the example problem from the original paper by Dr. 
Greenberg [1], which demonstrates the use of the algorithm on bounded 
variable problems. 

Problem 11 is a simple text book example [5] which depends heavily 


upon the algorithm modification requiring an immedia?« search for integer 
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solutions. This problem also appears in reference [8] to demonstrate an 
all integer algorithm by R. E. Gomory. 

Problem 12 is an exercise from [9] which demonstrates the existence 
of a set of relatively small integer LP problems the solution of which 
can frequently be quite tedious and inefficient when employing R. E. 
Gomory's all integer algorithm [8]. Although it has been proven that this 
particular algorithm will converge to an integer solution in all cases, 
this convergence can be so slow as to require the use of an alternate all 
integer procedure such as the algorithm employed by the program presented 
here. (Note the relative ease with which the program handles solution of 
the problem). 

Problem 13 was specifically developed to demonstrate how the program 
will handle a problem which has a feasible continuous solution but no 
feasible integer solution. 

Except where specifically indicated, the variables are bounded below 
by zero and above by infinity and are all required to be integer. 

A. SIX FIXED CHARGE PROBLEMS [4]: 
i 


Maximize Cx 


Subject to _-Fa(X) + ALY 


x. Se oe = 


All problems are similar except for parameters Ay > aos and by, and all 


unsubscripted variables are vectors. 


Fl F2 Al A2 A3 5 2 So S4 
max 0 0 ] ] | 0 0 0 0 


SUBJECE to 


Problem 


THREE IBM TEST PROBLEMS [4]: 


Problems 7 and 8 are identical with the exception of b. 


(Note: 


> > 
Min c'x 


Subject to 


min 


Subject to: 


| Ce oma — © 2) —! 


fc 


ol 


=I CGC — © —_ & 


Al 


Cy CS 


— seat Ol CE. OC 


A2 


C1) Sh 


2/ 


A3 


SS (.- mh Do 


Slack variables must be added). 


>| 


oOo Oo © = 


18 
18 
2] 


18 
19 


S2 


SS =" 


Oo OO x- S| —_— —S © 


So 


Oo — © © 


$4 


ot GD. wD 


(Note: 


Problem b, by 
7 5 5 
8 4 4 
Problem 9: 

I =O 
min 13 iS 
Subject to: 

4 5 

20 21 


1] ie 


MISCELLANEOUS PROBLEMS: 


Problem 10: 

‘4 2 
min 9 / 
Subject to: 

] -3 

-2 6 
-2 
Problem 11: 

*4 a2 
min 10 14 
Subject to: 

8 11 
2 2 
9 6 


15 


17 
V2 


96 
200 
10] 


Problem 12: 


min 


Subject to: 


Problem 13: 


min 


subject to: 


10 


10 
10 
10 
-10 


a 


Xa b 

0 

0 = of 

] = 15 

aA X5 
0 0 
0 0 
-| 0 
0 ] 
0 0 


95 
45 


V. COMPUTATIONAL RESULTS 


Two factors significantly affect the success or failure of the 
program as it processes each problem. One of these is the spread between 
the maximum and minimum coefficients in the objective function of the 
equivalent problem. Should this spread be wide enough, it can easily be 
demonstrated that the columns corresponding to the one with the high 
objective function coefficient in subsequent sections may require an 
extremely large number of sections prior to being marked as the minimum 
C.. This will require that each section be provided "fresh" section 
space in core (i.e., there will be no space available for reuse since no 
section will become fuily marked until late in the computation), and that 
the program runs the high risk of running out of space prior to reaching 
a solution. 

Another obstacle to successful problem solution is the size of the 
maximum period for each section. As described previously, the higher the 
period, the more the distinct column vectors of fractional parts which 
can be formed by the algorithm; hence, the column vector which produces 
the optimal solution very likely will be generated only after a large 
number of sections. Table I is a compilation of seem Gior results 


/ The 


from five additional problems which the program failed to solve. 
high section counts and corresponding high computation times make the use 


of an iterative scheme of the type employed by the algorithm very 


These problems are listed as numbers 5 through 9 of the first 10 
appearing in [4] and are of interest here for two reasons: none was 
larger than six constraints and 11 variables, and all had relatively high 
common denominators. 
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TABLE I 


Additional Test Problem Results 


COMMON be APPROXIMATE 
PROBLEM DENOMINATOR SECTIONS TIME (SECS) 
5 and 7? 19400 1744 65] 
754 268 
geen: 32000 259] 969 
967 350 
9 2000 1400 895 
878 436 
MAX Cj WHEN 4, SECTION #1 Cs REQUIRED TO PRODUCE 
PROBLEM PROGRAM STOPPED Min Cs Max C3 INTEGER SOLUTIONS 8 
Piende7 59750 4000 9000 244600 
30450 
6 and 8 118000 1300 5550 398000 
56000 
9 5600 400 800 6000 
4400 


Scomputed using the answers supplied in [4]. 


"Both problems are identical with one exception: the first has bounded 
variables and the second introduces two additional constraints to produce 
the bounds. 


rhe first figure represents values for the problem under the "course" 
duplicate column elimination method; the second figure represents values 
when run under the "fine" method. All timing figures are exclusive of 
input/output times. All problems stopped because the limitation of 450 
section spaces was exceeded. 
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unattractive economically, at least for those problems whose common 

denominators cannot be reduced into the hundreds. '! 
In addition to the inefficiencies associated with problems with high 

common denominators, there also exists the possibility, albeit remote, 

of computer oriented round-off errors for these same problems. The 

round-off errors occur in the computation of the continuous solution 

basic variable values and equivalent problem coefficients and have the 

effect of changing a problem with a feasible integer solution to one 

with no feasible integer solution. This has occurred, however, in just 

two problems (listed in Table I), both of which had 32000 as their common 


12 


denominators. The particular error appeared as a miscalculation of 


1/32000 in one fractional part value. No other problem listed in Table I 


3 Although these errors destroy any possibil- 


experienced such an error. 
ity of arriving at correct integer solutions, it would appear as if they 
occur only for extremely high common denominators and available data 
indicates that perhaps the iterative scheme should be abandoned for these 
areBT ene in the first place. 

In order to reduce total storage requirements by approximately one 


third, the size of the storage word for the fractional parts of the equiv- 


alent problem constraint coefficients and right-hand sides was reduced 


Ney prior developments, the period is necessarily less than or 
equal to the common denominator; the highest period for the successful 
test problems was 320. 


Verhe error was artificially corrected to produce the data for Table I. 


"this fact was verified through the use of a computer program, devel- 
oped by Dr. R. Shudde of the Naval Postgraduate School, which provides 
continuous results in integer format. The utilization of such a program 
will, of course, eliminate all possibility of round-off error. 


oC 


by one-half. The particular procedure employed to effect this reduction 
is peculiar to the IBM System 360 and has the effect of limiting the 
values of equivalent problem common denominators to 32/67; in light of 
the preceding discussion, this does not however appear to be too 


unreasonable a restriction. 
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TABLE II 


Solutions 
Optimal OPTIMAL VARIABLE COSTS 
PROB- Objective Subscripts 
LEM Function 1 2 3 4 5 6 7 86 JY 10 TT 2c 
Value 
| 14 7 jm 0 07 a Tower oO 
O . 0 WOR pO 8 ens ee) 
] ] 8-5” 708.0. |. sGmEZ 
2 8 
] 4 “40 ~ | Osa 
] ce 4 Slee OG eee 
] | 2&6. OC Oe 2 oe 
qe These: lesa a 


6 0 5 1 0 0 

‘ i Tes oo Go Gf) (Clee 
i 0.0 6 8 2 I xOMErO 
eS, 50 Oe ee 

: S 2) ee. 
| alls? 407 ScmCneeaieek 
oT) 08 5 ee 
a O° 7 1 oe oe 
Gee Ol Geen Qe 

6 8 Welteeye co OCS 
i 0 4 ee eee! 
Tec Ce 
Qi 0s 5 0 enON Os 
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Time/space limitations were reached prior to solving for all alter- 
native optimal solutions. 
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TABLE II— CONTINUED 


OPTIMAL VARIABLE COSTS 


Optimal 
PROB- Objective 


Subscripts 


Function 
Value 


LEM 


6 8 1 8 Ole 2. vis 14 


5 


1 


89 


TABLE II— CONTINUED 


OPTIMAL VARIABLE COSTS 


Optimal 
PROB- Objective 


Subscripts 
8 9 10° ismei4 


i 


6 


Function 
Value 


LEM 


(Continued) 


187 


17 


10 


JZ 


ia 


12 


INFEASIBLE 


1s 
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TABLE III 


Sections Required and Computation Times 


ea EEM _— 17 Mik 17 
Sections Time Sections Time 
] 247 e355 768+ 272206 
2 253 AAS 769 287.48 
3 340 28520 967+ 360551 
4 4 0.08 4 0.08 
5 185 19.255 960 347.86 
6 145 9.15 580 164.90 
7 8 Or22 8 OPC 
8 32 1.01 330 64.70 
9 2000 416.40 412 65.60 
10 5 0.06 5 0.06 
1) 39 0.49 39 0.49 
12 . 0.01 3 0.01 
les INFEASIBLE 
Us 


Refers to the modified duplicate column elimination method which 
will provide a bound for the optimal solution. 


Opofers to the original duplicate column elimination method which 
ultimately provides the optimal solution. 


The the nearest 1/100 second; exclusive of input/output times and 
alternate optima requirements. 


1B po ferred to as iterations in Table IV, this is new sections formed 
and not section space required; '+' means unsolved. 


ey 


VI CONCLUSIONS 


Table IV is a comparison of section!” requirements of the program 
with three IP programs available through SHARE [4]. Although in general 
the SHARE programs require considerably fewer iterations, the computer 
program presented here has several rather attractive benefits associated 
with its use. As discussed previously, all integer solutions to the 
equivalent knapsack problem are systematically produced in order of 
increasing objective function value; it is the associated iterative scheme 
of solution which will provide all existing alternate optima to integer 
LP problems. Also, as alluded to in the preceding discussion of test 
problem 12, the basic algorithm is a good substitute for Gomory's all 
integer algorithm in the soiution of at least some integer problems. The 
computer program presented here does, however, have definite limitations. 

As mentioned in the preceding section, the size of the period, and 
hence the common denominator, plays a major role in the program require- 
ments for core and time; it is these requirements which ultimately 
restrict the size of the problem and the number of sections which the 
program will accommodate. Since the only test problems which failed to 
produce at least one optimal solution were those whose common denominators 
ranged from 2000 to 32000, the question arises: can this common denominator 
be approximated (i.e., reduced) to a point at which corresponding periods, 
and hence time and space requirements, are no longer prohibitively high 
and at the same time solutions do net become distorted? The ultimate 


utility of the program rests on the answer to this question. 


Ob pogram iterations refer to sections formed during the "fine" duplicate 
column elimination run; iterations for the three SHARE programs mean total 
pivot steps required to solve the problem. 
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TABLE IV 


A Comparison of Iteration Requirements 


PROBLEM NUMBER CONSTRAINTS VARIABLES PROGRAM LIP] IPOZ IPO03 


] 4 9 768+ 25 19 5] 
3 4 9 967+ 22 17 80 
5 4 9 960 2 | 18 58 
6 4 9 580 iy 29 35 
IpMZ — IPM3 
7 7 14 8 1] i 5 
8 7 14 830 30 10 lel 
9 3 i ANZ 63 Z 28 
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APPENDIX A 


Input Data and Output Formats 


Input ~2 
Cara |, G@ae.: 
Gen 10: 
Com: 
CC die]: 
Cem) 2: 
Card Set 1: 
co l& 
Cea 
Cees: 
Ceulc- 
Cardeset 2: 
cCeurie 
cc 4: 
ce” 9: 
20 


number of constraints 
number of variables (including slack) 
1 if bounds are required 


Problem title, if any ("STOP" after last card of 
last problem deck) 


1 if any existing alternative optimal solutions 
are to be listed 


These are the constraint coefficients, A, in the 
form A(I,J), where I is the constraint number, 

J the variable. 

1 if last card in the set 

constraint number 

variable number 


coefficient value 


These are the right hand sides, H, in the form 
H(I), where I is the constraint number 


1] if Jast card in the set 
constraint number 


right hand side value 


All input defaults to zero (bounds to zero and infinity). A11 


data will be right adjusted to the card column (cc) indicated. 


40 


Card Set 3: These are the objective function costs, A, in the 
form A(M,J), where J is the variable, M the number 
of constraints plus one (completed separately). 

ce 1: 1 if Jast card in set 
co 4: variable number 


ceo: cost 


Card Set 4: These are the upper bounds on the variables in the 
form XUB(J), where J is the variable. 


een: 1 if last card in set 
Coes: variable number 


cc 9: variable bound 


Output 

The first series of lines provides a review of the input data, in 
its original format. The continuous solution is then listed with its 
computation time. Next, all intermediate feasible solutions are listed 
with their individual computation times, iterations required and total 
section spaces required. (If alternate optima are available, they will 
appear at this point also.) The first section in the integer solution 
and the common denominator are then listed to provide a feel for the 
iteration requirements of the particular problem. Finally, the last 


optimal solution and its time and iteration requirements are listed. 
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APPENDIX B 


Overlay Structure“ 


The program, with its present capacity, requires approximately 
370 thousand bytes of storage in the IBM System/360-67 computer. By 
utilizing an overlay structure, this requirement can be reduced to 
approximately 360 thousand bytes. Although relatively small, this is 
as large a reduction as possible due to the high degree of interdependence 
among the subroutines in the program. Common blocks were specifically 
developed to take maximum advantage of the overlay structure. 
The following cards, were placed directly behind the program in 
object deck form and were the product of the overlay tree of Figure 1. 
OVERLAY ALPHA 
INSERT LP, ELEM, PIVOT, MIN 
OVERLAY ALPHA 
INSERT INTPRG 
OVERLAY BETA 
INSERT PMOD 
OVERLAY BETA 
INSERT CSUBR, FEAS 


el References [10] and [11] were utilized extensively in the development 


of the overlay structure and should be consulted for a more detailed explana- 


tion of the techniques employed by the program. 
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MAIN 





AXE 
TIMETT 
# ALPHA 
INTPRG 
# BETA 
PMOD CSUBR 
FEAS 


THE OVERLAY TREE 


Figure |. 
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SUBROUTINE MIN (T) 


OO 


AH,HH,EE,RL» 


24) ,X(24),1B(14) ,AX(14) »XLB(24) ~H( 14), 
’ I 
G I 
0 
BS (AX(1)))25,25,3 
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SUBROUTINEAXE 


COMMON/ONE/XUB (24) 9X24), IBC 14) sAX( 14) »XLB(24) gHIL4), 
14014324) »X1(14) 
CCMMON/TWO/Y(14) 9B(0 14514), 1SOL(14) pASAVE( 14924), 
LHSAVE(14) 
CCMMON MMyNyMy JSe Ep IRy ADs Dl y1TRyXH» AHyHH, EERE» 
LXTyXK»y [De BND ol » [Ws LCHKy rONAT. tot, 1OPP,LALT 
DO 21 I=1,” 
AX(T)=0. 
DO 21 K=l)*M 
AX (IL)=AX(L)#B( 19K) €A(KyJS) 

21 CONTINUE 
AX (MM41)=AX(MM41) #A(MM#1,) JS) 

22 RETUPN 
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SUBROUTINE PIVOT 
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